Bounds on the mass of the V quark, revisited 
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Recent results from the DELPHI collaboration Q led us to review the present bounds on the b' 
quark mass. We use all available experimental data for my > 96 GeV to constrain the 6' quark 
mass as a function of the Cabibbo-Kobayashi-Maskawa elements in a sequential four generations 
model. We find that there is still room for a b' with a mass larger than 96 GeV. 
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I. INTRODUCTION 



It has long been known that a sequential fourth generation within the Standard Model (SM) needs both quarks and 
leptons. Half a generation would imply that the gauge anomalies associated with triangle diagrams would not cancel. 
It is also known that SLC, and then LEP have set a bound on the number of light neutrinos [rrii, < Mz/^), 
which is indisputably equal to three. This bound applies to all new fermions that couple to the Z and one has to be 
^ ' extremely open minded to accept a fourth neutrino with a mass larger than around 45 GeV. Thus, there seems to be 
OO . no strong motivation for the search of a sequential fourth generation (for a review see 0). So why look for it? 

' Despite the strength of the previous arguments one should try to experimentally exclude the existence of a fourth 
generation. In fact such evidence does not yet exist. The most recent precision electroweak results 3 allow a sequential 

■ fourth generation if the quark masses are not too further apart ^. The same results also disfavour a degenerate fourth 
I family if both the leptonic and hadronic sector are degenerate. This is in agreement with the conclusions of Erler and 

■ Langacker 1^. However, as discussed in ref. there are several reasons to keep investigating this subject starting 
with the fact that precision results vary with time. In ref. ^ it can be seen that even if one takes a degenerate fourth 
family of quarks with 150 GeV masses, it is enough to choose a non-degenerate family of leptons with masses of 100 
GeV and 200 GeV and a Higgs mass of 180 GeV for the discrepancy with experimental data to fall from roughly three 

Oh. to two standard deviations^. Moreover, it is clear that any new physics will also influence these results. 
^ It was shown in refs. j3, 5] that the mass range \mt' —mb' \ < 60 GeV, where t' and b' are the fourth generation quarks, 

'T"! , is consistent with all available precision electroweak data. This range enable us to say that even if rrib' > mt' , the 
^ ■ decay b' t'W is forbidden. The decay b' t' W* although allowed, is phase space suppressed 0] and consequently 
extremely small in the mass range under study (from now on we consider mt' < mt'). Experimental data allow us 
. to go only up to m^' close to 180 GeV. Hence, the b' can not decay to a top quark. Furthermore, while some recent 
' studies |3, Q have constrained the Cabibbo-Kobayashi-Maskawa (CKM) elements of the fourth generation, they do 
not influence our results. Nevertheless we will take into account the 2a bound \Vtb\^ -\- 0.75|Vt'f,p < 1.14 Q coming 
from Z — > 66 to constrain the CKM element Vcb' as a function of the b' mass. 

Present experimental bounds on the b' mass above 96 GeV suffer from the drawback of assuming a 100 % branching 
ratio for a specific decay channel. As stated before the strongest bound on the b' mass comes from LEP and is 
nib' > 46 GeV. Here all 6' decays were considered. There are presently three bounds on the 6' mass for rrib' > 96 
GeV. The first one [l^, mb' > 199 GeV, assumes that Br{b' bZ) = 100%. We will drop this condition and use 
instead their plot of C7{pp b'b' -I- X) x Br^{b' ^ b Z) as a function of the b' mass. The second one (lid mh' > 128 
GeV, is based on the data collected in the top quark search. Because the DO collaboration looked for t —>■ bW, the 
analysis can be used to set a limit on <j{pp b'b' -(- X) x Br^{b' cW). By doing so we assume that the b and 
c quark masses are negligible and that <j(pp b'b') « cr{pp tt). The obtained limit mb' > 128 GeV assumes 
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[Ij This result is a strong bound on the mass difference of a possible fourth generation. Nevertheless, it should be noticed that the authors 

assume no mixing of the extra families with the SM ones. 
[2] Notice that wc make no assumptions on the values of the masses and couplings of the leptonic sector of the model. 
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Br{b' ^cW) = 100%. The third bound is from CDF and is based on the decay b' ^ b Z followed by the search 
for Z e~ with displaced vertices. Their excluded region is inside a rectangle in the lifetime (ct), 7111,1 plane with 

9 X 10^"^ cm < cr < 12 cm and rni, + Mz < mi,' < 148 GeV sides. Hence, the excluded region depends heavily 
on the b' lifetime. But, contrary to the top quark which has a lifetime of around 1G~^^ s, the lifetime of a sequential 
b' quark is expected to be extremely large, especially knowing that we are considering a heavy b' . In fact, depending 
on the CKM values and on the b' and t' masses, the decay length can be as large as 10"** cm or even 10"^ cm in 
extreme cases. Nevertheless, in this model, it is very hard to go beyond that value. It is worth mentioning that even 
with this huge lifetime, the b' always decays inside the detector and hadronization occurs before it decays. Thus, the 
limit obtained in which on top of what was said assumes Br{b' ^ b Z) = 100% can not be used in our analysis. 

Hence, we think it is worthwhile to reexamine the limits on the b' mass. We will use the CDF and the DO data 
which, together with the new DELPHI data, is all that there is available for 771^/ > 96 GeV. We will draw exclusion 
plots in the plane {Rckm, mt,'), where Rckm = I v^Tvti, I ' fro™ 96 GeV to 180 GeV without assuming a definite value 
for the branching ratios of specific channels. In some regions it is possible to combine all experimental data allowing 
a larger exclusion area. Notice that the use of the Rckm variable provides a new way to look at the experimental 
results. This variable enable us to actually use and combine all the available data. Moreover, the new form in which 
the results are presented will serve as a guide to future experiments since it is possible to know how far one has to go 
to exclude the regions that are still allowed. 

To end this section we note that there is, at present, no bound on a sequential 2/3 charged quark in the PDG but 
if we assume a 100 % decay to cW the bound is again 128 GeV [Tl| |. 

The paper is organised as follows. In section II we define the model and discuss the production and the decays of 
b' quarks. In section III we combine the theoretical and the experimental results to produce exclusion plots in the 
parameter space. Section IV summarises our results and conclusions. 

II. b' PRODUCTION AND DECAY 

There are several ways of extending the SM to accommodate a fourth family of quarks and/or leptons. A review 
of the different models in the literature is available in _3J. Obviously, the most natural and straightforward way to 
introduce a fourth family in the SM is just to add a (t', b') family with the same quantum numbers and similar 
couplings to all other known quarks. The same can be done for the lepton sector^. This is called a sequential fourth 
generation model and is sometimes referred to as SM4. The resulting CKM matrix has a very similar structure to the 
SM one. It is a 4 x 4 unitary matrix and it is assumed to be approximately symmetric. Besides the four new masses, 
there are 9 additional parameters compared to the SM: 6 mixing angles instead of 3 and 3 complex phases instead 
of 1. Because we are not concerned with CP-violation we take all CKM values to be real. In the SM4, the CKM 
elements that are not determined experimentally have more freedom due to the extra parameters introduced. This 
model has been the subject of wide study in the literature. Production cross sections for lepton and hadron colliders 
and b' branching fractions were calculated long ago. 

At LEP, a pair of heavy quarks is produced through the reaction e"*" e~ — > qq. For consistency with the experimental 
analysis, the process e~ b' b' was calculated using Pythia 0|, with initial state radiation (ISR), final state 
radiation (FSR) and QCD corrections turned on. We have cross checked the results using a simple program with the 
formulas of refs. Ti'l and which also include QCD corrections and ISR. Since the larger contribution to the cross 
section comes from ISR we have double checked by making use of the formulas presented in The results agree 
very well with the Pythia results. It should be noticed that near the threshold bound states would surely be formed. 
Without a detailed analysis of such bound states it is impossible to evaluate whether their contribution to the cross 
section would be relevant or not. So, if bound states do exist above the threshold, we are assuming that they give a 
negligible contribution to the cross section. Far away from the threshold the problem ceases to exist and the results 
we will show for hadron colliders are not affected by this approximation. 

The equivalent production reaction at the Tevatron is pp ^ b' b' + X, with the relevant processes being gg (qq) 
b'b'. Even though this cross section can not be found in the literature it is generally recognised that all massive 
quark pair production cross section are very similar due to its hadronic nature. The same is true for the subsequent 
decays into leptons and for the detector efficiency. Thus we can use the exact order corrected cross section for the 
production of top quarks . This approximation is used both by the CDF and the DO collaborations in their studies 
on b' production and decay. In it is also assumed that the final states are exactly the same as the top quark 



[3] Now that it is finally accepted that neutrinos have mass, the SM has to be changed to accommodate this new feature. We do not restrict 
ourselves to any specific mechanism that generates the very high neutrino mass needed in SM4. 
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ones. Notice that the error in calculating the hadronic cross section is much larger than the corresponding error in 
the leptonic one. For ruq = 100 GeV the error is about 38 % falling to 12 % for iriq — 200 GeV. This will be reflected 
in the exclusion plots. 

All b' decays were exhaustively studied by Hou and Stuart in [TsL IT9l l2^. *2l'| and by Haeri, Eilam and Soni 22]. Hou 
and Stuart have shown that the b' is peculiar in the sense that 1-loop flavour change decays (FCNC) can dominate 
over charged current decays (CC). Depending on the values of the CKM matrix elements and as long as the Higgs 
channel remains closed, there are mainly two processes in competition: b' b Z and b' ^ c W. As soon as the Higgs 
channel opens the decay b' ^ bH can be as large as 6' — > 6 Z. Other decays like b' ^ bg and b' ^ bj and three body 
decays give smaller contributions but can sometimes be relevant. 

The three body decays 6' ^ 6e+ e~, b' ^ bvv and b' bqq, including box diagrams were calculated in At 
that time, the top mass was still unknown and the t' was taken to be much larger than the top mass. Under these 
conditions and for the range of the b' mass in study, the sum of all three body decays could be as large as &' — *■ 6 g. It 
could be even larger for a "small" t mass and a very large t' mass ^20]. But it turned out that the top mass is « 175 
GeV and electroweak precision measurements force to be close to mb' for the range of b' mass under consideration. 
In our case we estimate all three body decays plus the decay b' 67 to be smaller than b' bg. Nevertheless, 
because we want to make a conservative estimate we will take it to be as large as 6' — > 6 g. 

Using the unitarity of the CKM matrix, its approximate symmetry Vt'b' Vfb ~ Vtb Vtb'^ and taking Vub' Vub ~ and 
Vcb ~ 10^^ we can write all branching fractions as a function of three quantities alone: Rckm, "mf and nib'- Notice 
that the two last conditions do not play a significant role in the final result. Using a very large value like for instance 
Vub' Vub ~ lO^'* gives a contribution much less than 1 % to the b' ^ bZ decay width. The same is true when we 
relax the condition Vt'b' Vt'b ~ Vtb Vtb' near to a GIM cancellation region. Relaxing this condition leads to an increase 
by several orders of magnitude of the values of the NC decay widths but they are always much smaller than the GG 
decays in that region. 

One-loop calculations of the NC b' decays were performed using the FeynArts and FeynCalc |2^ packages for 
generating and computing the complete set of diagrams and the LoopTools/FF ^4 1 p ackages for the numerical 
analysis. We have carried out several checks in the four generations model following pi llsL Il9l 12(1 l2ll| and in the SM 
against [25. ,26J. We have found full agreement in both cases. 

The branching ratios depend on three quantities alone and 96 GeV mb' ^ 180 GeV. So, we just have to decide on 
what values of Rckm and mf to use. Since we know that nit' is limited by precision data we will study two extreme 
cases ruf = nib' + 50 GeV and the almost degenerate case me = rUb' + 1 GeV. In the exclusion plots Rckm is a free 
parameter and so no assumptions on its variation range were made. However, there is a hint on its most significant 
values coming from the fact that the competing NC and GG cross at 10~^ ^ Rckm ^ 10~^. We will come back to 
this point later. 

In fig. ^we present the branching ratios as a function of the b' mass with Rckm — 0.001 and rrit' — nib' — 50 GeV. 
The closer to nib' — 96 GeV we are the larger b' ^ bg gets due to phase space suppression of the competing NG 
6' ^ bZ. In fact, for an almost degenerate fourth family and small values of Rckm, b' ^ bg can be the dominant 
NC for nib' — 96 GeV. As soon as one moves away from this value, b' ^ b Z becomes the dominant NC. If the Higgs 
channel is closed , for nib' > 97 GeV, the competition is always between b' ^ cW and b' ^ b Z. As nib' rises so does 
the NG except if the GIM mechanism gets in the way. It can be clearly seen in the figure the GIM mechanism acting 
for nib' « 125 GeV, that is, nit' — nit = 0. Then the NG rises again and the GG falls crossing at 140 GeV. When 
Rckm grows so does b' ^ cW and the crossing point is shifted to the left. As the mass difference tends to zero the 
GIM effect is shifted to nib' ~ fnt- 

In fig. 2 we show the branching ratios as a function of Rckm with nib' = 110 GeV and mt' — nib' = 1 GeV. As 
we already knew, the NC are favoured by small values of Rckm because Rckm is a direct measure of the charged 
currents. Again, when nib' grows so does b' b Z and the crossing point is shifted to the left. The same happens 
when mt' — nib' decreases as explained above. 

III. RESULTS AND DISCUSSION 

We are now in a position to draw exclusion plots on the plane {RcKM,'m-b') with mf as a parameter. Using the 
latest experimental data from the DELPHI collaboration and the data from the CDF and DO collaborations together 
with the theoretical values of the cross sections and the branching ratios we have drawn the exclusion plots shown in 
the figures below. The upper regions are excluded by the limits on Brb'^cW and the lower regions by the limits on 
Brb'-,bz- 

The results based on the DELPHI data, are shown in figs. 3 and 4. The only difference between the two plots is 
in the value of rrit'- It can be seen that as mt' — mb' grows, the allowed region gets smaller. This is because Brb'^bz 
decreases with mt' due to a GIM suppression as long as mf is smaller than mt and {mf — nit) 0. On the contrary. 
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FIG. 1: Branching ratios as a function of the b' mass. The Higgs channel is closed. Rckm = 0.001 and = m;,/ + 50 GeV. 
The dashed line is 6' — » hZ] the full line is 6' — » hg and the dotted line is 6' — » cW . 
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FIG. 2: Branching ratios as a function of the Rckm with rribi = 110 GeV and = mj/ + 1 GeV. The dashed line is b' 
the full line is b' — » bg and the dotted line is b' — > cW. Higgs channel is closed. 
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Brh'^cW does not depend on the t' mass. Hence, as mf grows, Brb'^cW becomes dominant and the upper excluded 

region increases. 

The reason why there isn't a lower bound close to 96 GeV in both figures is because of the competing neutral 
currents. Close to the Zh threshold (« 96 GeV), b' ^ bg dominates over b' ^ bZ and the experimental bound 

on Bry,i^}jz becomes useless. As one moves away from the Zb threshold, b' ^ b Z becomes the dominant neutral 
current. Brf^bz falls less sharply with mf than the other neutral currents and that explains why there is a lower 
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FIG. 3: 95 % CL excluded region in the plane {Rckm, mi,i) with rrit' — mi,i = 1 GeV, obtained from limits on Br^i^b z and 
Bry^^w (top). 



bound for e.g. at 777,5/ = 100 GcV in fig. 4 but not in fig. 3. After 102 GeV almost all values are allowed because the 

experiments are not sensitive to those mass values. 
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FIG. 4: 95 % CL excluded region in the plane {Rckm, my) with me — my = 50 GeV, obtained from limits on Bry^),z 
(bottom) and Bry^cw (top). 

In figs. 5 and 6 we show similar plots but using the CDF and the DO data. The DO data is responsible for excluding 

the upper regions because it deals with CC as the CDF exchides the lower regions due to the bounds on NC. The 
three curves marked upper, central and lower are related with the theoretical error bars in the b' production cross 
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FIG. 5: 95 % CL excluded region in the plane {Rckm , rny ) with mti — my = 1 GeV, obtained from limits on Bry_ (, z by the 
CDF coll. (bottom) and Bry^^^r by the DO coll. (top). Upper, Central and Lower curves correspond to the values used for 
the y production cross-section. 



section. Again and for the same reason the excluded region grows with m^/ — mjji . This means that like the constraints 
from precision electroweak data, the experimental data also disfavours a fourth family with a large mass difference 
between the two quarks. 

In some cases the allowed regions in the CDF/DO and DELPHI plots overlap and the excluded region grows. For 
instance, considering my = 100 GeV and mt> — my = 50 GeV we get for DELPHI 4.5 x 10"'* < Rckm < 8.4 x 10"'' 
and for CDF/DO (lower) 6.7 x lO""' < Rckm < 1-1 x 10~^. Hence, the resulting excluded region is 6.7 x lO""' < 
Rckm < 8.4 x 10-^. 

With the bound \Vtb\^ + 0.75\Vt'b\^ < 1.14 and assuming \ Vtb\ « 1 it is possible to limit the value of the matrix 
element Vcy. For the same value of the b' mass, my = 100 GeV we know that Rckm < 8.4 x 10"^ and so 

Vcy < 8.4 X lO^VO-14/0.75 « 3.6 x 10""* 

with mt' = my + 50 = 150 GeV. The bound gets weaker for smaller mp 0. 

Finally we show an exclusion plot with the Higgs channel opened and a Higgs mass of 115 GeV. As we expected, 
the inclusion of the Higgs makes the excluded region to shrink. By itself, the inclusion of one more channel always 
diminishes the branching ratios and consequently less values will be excluded. Like b' b Z, b' bh is larger for 
small Rckm and large my . Hence in this region of parameter space it competes with b' b Z and b' ^ cW making 
the allowed region larger. For a detailed analysis of the so-called cocktail solution see Jj. 



IV. CONCLUSION 



In this work we have found the allowed b' mass as a function of the CKM elements of a four generations sequential 
model. Using all available experimental data for my > 96 GeV we have shown that there is still plenty of room for a 
b' with a mass larger than 96 GeV. We have also shown that the allowed region decreases as mc increases. In fact, 
as the gap between the fourth generation quark masses increases the allowed region shrinks. Notice that this is in 
full agreement with the tendency of a small mass gap, if not completely degenerated, favoured by the electroweak 
precision measurements. 

All plots show that Rckm is for sure smaller than « 10"^ and it can be as small as « 10"''. This is not surprising 
because this region is exactly where we expected it to be. In fact, the CKM values we know so far suggest that 
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FIG. 6: 95 % CL excluded region in the plane {Rckm, rny) with m^/ — my = 50GeV, obtained from limits on Bry^j^z by 
the CDF coll. (bottom) and Bry^^'^ by the DO coll. (top). Upper, Central and Lower curves correspond to the values used 
for the h' production cross-section. 



Vcb' ~ 10^"' — 10^^. If Vtb' ~ 10^^ then a value of Rckm between 10^^ and lO^"' is absolutely natural. Moreover, 
the limit we have obtained for Vcb' in the last section makes it even more natural. 

We know that the DELPHI analysis jj] is being improved. In the near future we hope to reduce very much the 
allowed region in figs. 3 and 4. As far as we know there are no new results from the CDF and the DO collaborations 
improving their bounds. For large rriti —mb', and for some values of mb' the CDF/DO limits almost shrink the allowed 
region to zero. Hence, a small improvement in the analysis could disallow a large region of the parameter space. 

As for the future, searches in hadron colliders will have to wait for the Runll of the Tevatron and for the Large 
Hadron Collider (LHC). The b'b' production cross section increases by roughly two orders of magnitude at the LHC 
compared to the Tevatron. Thus LHC will be a copious source of b' pairs. With high values for cross section and 
luminosity, if background is suppressed exclusion plots can be drawn for a very wide range of b' masses. However, we 
have to worry about two problems in future searches. From the theoretical point of view we have to take into account 
all the possible hierarchies in mass, for instance one could have mt> < mt < mb' or rrit < rrit' < mb'. A careful study, 
including also the possibility of finding a Higgs has to be done. From the experimental point of view we have to know 
how the detectors will perform. 

Nobody knows yet if there is going to be a Next Linear Collider with energies of y/s = 500 GcV or y/s — 1 TcV. 
NLC would allow us to go up mb' — 250 GeV or mb' = 500 GeV which is close to the perturbative limit. Depending 
on the available luminosity, and because a small background is expected, we believe that the excluded region would 
be very large, probably allowing the exclusion of some values of mb' regardless of the values of the mixing angles. 
However, if a Higgs boson is found the excluded region will surely be smaller and will depend on the mass and type 
of Higgs boson found. For a detailed discussion on future searches see Q. 

In summary we believe that there is still experimental and theoretical work to be done to find or definitely to 
exclude a sequential fourth generation of quarks at the electroweak scale. 
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FIG. 7: 95 % CL excluded region in the plane {Rckm, my) with me — my = 50GeV, obtained from limits on Bry^^z by 
the CDF coll. (bottom) and Bry^^yy by the DO coll. (top). The darker region is the excluded region with a Higgs boson of 
115 GeV. Central values were taken for b' production cross section. 
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